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ABSTRACT 

This thesis is concerned with cyclic block codes which 
can be used for the detection and correction of errors in 
a transmitted message which are produced by various types 
of noise. Computer programs were developed and used for the 
actual encoding and decoding process. Advantages of using 
the computer as against using various types of dedicated 
hardware is demonstrated. Two different methods of decoding 
are presented: the minimum distance decoder and the syndrome 

method decoder. Pseudo random noise sequences were also gen- 
erated by computer program and used to simulate noise distur- 
bance of the encoded transmitted message. Codes of several 
rates and with varying degrees of simulated channel noise 
were studied and compared with respect to the probability of 
error. It is shown how the methods developed in this thesis 
can materially help in choosing the 'best 5 code for a given 
noisy channel, consonant with other specified parameters for 
message transmission. 
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I. INTRODUCTION 



After the appearance of Shannon’s classic papers in 1948 
and 19^9, a great deal of research has been devoted to the 
problem of designing efficient schemes by which information 
can be coded for reliable transmission across channels which 
are corrupted by noise. The channel is described statisti- 
cally by giving a probability distribution over the set of 
all possible outputs for each permissible input. 

In Shannon’s model, a randomly generated message produced 
by a source of information is 'encoded,' that is each possible 
message that the source can produce is associated with a 
signal belonging to a specific set. It is the encoded message 
which is actually transmitted. When the transmitted encoded 
message is received, a 'decoding' operation is performed, that 
is, a decision is made as to the identity of the particular 
signal transmitted. The main objective is to increase the 
elements of any set to be transmitted, and at the same time 
decrease the probability of error at the output of the decoder 
How well one can do these things depends essentially on the 
properties of the channel. 

The establishment of digital technology provided a power- 
ful way of utilization in satellite communication, data trans- 
fer between computers and in military applications. 

Encoding and decoding operations were done by a mini- 
computer (DEC PDP - 11/40) , channel noise was simulated by 
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a computer program. The results were obtained from the 
computer program close to actual world binomial distribution. 
The codes investigated were members of a type known as cyclic 
codes . 
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II . BACKGROUND 



In a communication channel, noise and disturbances modify- 
ing the signal create errors, a simple way to reduce uncertainty 
at the receiver due to errors is to simply transmit the message 
two or more times, a much more efficient way of providing means 
for detection and correction of errors involves the use of 
error correcting codes (controlled redundancy). 

Controlled redundancy or error correction coding is commonly 
divided into two main groups: (1) block codes (2) convolutional 

codes. Convolutional codes are decoded by a statistical pro- 
cedure due to it's continuous (bit by bit) nature. On the 
other hand to decode the block codes, a whole word (block) has 
to be received. 

A block diagram of a digital communication system is 
shown in Figure 1. The information source provides a message 
or sequence of messages to be communicated to the receiving 
terminal. Message may be of various types (1) sequence of 
letters as in a telegraph or teletype system, (2) an analog 
time function as in radio or telephone, (3) a function of time 
and two space coordinates as in black and white television, 

(4) several functions of several variables as in color 
television, etc. Since the purpose of the source encoder 
is to present the information source output by a sequence of 
binary digits, one of the major questions of concern is to 
determine how many binary digits per unit time are required 
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Figure 1. Digital Communication System 



to represent the output of any given source. The error cor- 
rection encoder used in this thesis is a cyclic encoder which 
is a type of "block encoding system. Channel is merely a 
medium used to transmit the signal from transmitter to receiver. 
It may "be a pair of wires, a coaxial cable, free space, a "beam 
of light, etc. In any kind of channel the signal may "be per- 
turbed by noise. The channel modeled in this thesis is a 
binary symmetric channel, which is shown in Figure 2. The 
error correction decoder performs the inverse operation of 
that done by the channel encoder, and in addition corrects 
the errors altering the message to the extend of that the 
errors can be corrected. The source decoder does the inverse 
operation of the source encoder, changing the data to the 
original signal. Destination is the person or thing for whom 
the message is intended. 

A. PRINCIPALS OF BLOCK CODES 

As pointed out earlier, coding and decoding systems are 

implemented by with the aid of minicomputer (DEC PDP - ll/4o) . 

Only binary codes were considered. 

Notations used in this thesis: 

= Number of information bits 

= Number of check bits 

= Total word length in bits (n=m+k) 

= Maximum number of errors can be corrected in 
one word 

= Data rate (R=k/m) 

= Binary symmetric channel (BSC) parameter 



k 

m 

n 

e 

R 
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P( 0/1) = P(l/0) = p 



Figure 2. Binary Symmetric Channel 



Channel 

Output 
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- Source encoder output 

= Error correction encoder output (code word) 
M - Characteristic matrix of the code 

G(X) = Generator polynomial 

H(X) = Check polynomial 

d = Hamming distance between code words 

2 = Noise (as a word) 

In order to correct e-tuple or less errors in one word, 
there are two inequalities to be satisfied, 
a. Hammings lower bound inequality 




or equivalently 




Hammings lower bound inequality is necessary but not sufficient 
for constructibility on an e-tuple error correction code. 

b. Varsharmov - Gilbert - Sacks condition (upper bound) 



-jn 




2e-l 




This condition is sufficient but not necessary. 

These two bound's box in the number of check digits, m , 
required for a block code, where each word consists of n 
digits . 



16 



The code rate is the ratio of the message digits per word 
k , divided by n , since k equals n-m, it is obvious that 
increasing the number of check digits decreases the data 
rate, on the other hand increasing the number of check digits 
decreases the number of uncorrectible errors, therefore for a 
given signal to noise power ratio to desire to keep the data 
rate high, it is in conflict with the desire to minimize 
errors. One is than faced to with the task of making an 
engineering compromise. 

B. DESCRIPTION OF CYCLIC CODES 

In this thesis a special class of block codes known as 
cyclic codes are described. This kind of codes have two special 
advantages over ordinary block codes: 

(1) Encoding operation is easy to instrument 

(2) A large amount of mathematical structure in the code 
makes it possible to find various simple decoding 
algorithms . 

Let X=( X;L ,x 2 ,x 3 x k ) be an arbitrary sequence of 

information digits with each x^.l^i^k an element of a 
Galois field (GF 2) (which is 0 or 1) . An (n,k) code is a 

code in which the code words TaHw-^w^w^ » w n ) corres " 

ponding to each M is a sequence of n> k letters, generated 

by the rule 

k 

W n = 2 x i h,n 

i=l 
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Where the elements b. are arbitrary chosen elements of 

i , n 

GF(2) the additions and multiplication are operations in 
GF( 2) 

A set containing at least two members that is closed 
under two operations (called ’addition' and 'multiplication') 
is called a field. Roughly speaking, a field is a set in 
which we can do addition, subtraction, multiplication, and 
division without leaving the set. The field I of matric 
polynomials p(I) of degree - 1 has 2^ elements; I is 

called the Galois field of order 2^, written as GF (2 q ). 

The type of block codes can be represented 



b n w n_1 + 
n-1 



Va* 



n-2 + 



, n-3 , 

V3 W + 



+ b-^w + 



b 



o 



if any right or left cyclic shifts of this word is another 
word, and any linear combinations of such code words is 
another code word, the code is called a cyclic code (name of 
the cyclic code comes from the cyclic shifts of words to get 
another code word) . 

In the binary case multiplication of any code word by 
positive powers of two (left cyclic shift) is another code 
word, conversely multiplication by negative powers of two 
(right cyclic shift) is also another code word (in modulo 2). 

Generation of any code word can be realized by a k-stage 
feedback shift register or m-stage feedback shift register. 
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C. CYCLIC ENCODING 

1. k>stage feedback shift register (Figure 3) : 

This type of encoder has binary storage cells F 0 ,F i’ 

F 2' ’ • ’ ,F k-l switches g 0 ’ S l’ g 2 g k -l if Si = 1 

the corresponding switch is closed, if g i = o the switch is 

open, the device also includes a modulo 2 adder. The system 

is controlled by a clock pulse. At t = 0 the binary message 

to be encoded is put into cells of the register. At each 

clock pulse the contents of F^ are shifted to F^_ 1 and the 

new number in F^_-^ is 



• • • • 



• +g k-i x ,-i 



«o x o + g l x l + g 2 x 2 + 
where x Q . . . , x ^_2 is the message word to be encoded 

and is the contents of register cell F^. 

The operation of a feedback shift register can be 
described by a matrix equation. If x^ is the number stored 
in F^ before the clock pulse and if x'^ is the number stored 
in the same register after the clock pulse, the contents of 
the register cells after the first clock pulse becomes; 

V x i 

x ;=x 2 



X k-2 X k-1 



X k-l =g 0 X 0 +g l X l + 



+ g k-l X k-l 
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Figure 3. k-Stage Feedback Shift Register. 



In matrix form; 



[x] =[t][x] 



where 



X = 



k 0 



L 0 



X = 



X. 



x k-i 
input word 



k-1 



T = 



0 10 0 . . . .0 



0 0 10 . . . .0 



0 0 0 1 . . . .0 



L 



g 0 g l g 2 



• • • 



Sfe- 1 



characteristic matrix 



Any initial message put into the shift register cells Fq’^I’ 

. • , (unless all zeros) will repeat itself after n-1 

clock pulses. At this point (t = 0 or t = n) a new message 
to be encoded is put into shift register cells, at each clock 
pulse the contents of shift register cell F Q will be taken 
as a encoded word bit, as one can see, the first k bits 
out of the shift register will be the actual message bits 
(information bits). At t = n-1 clock pulse the last encoded 
bit will be out of the shift register cell Fq , the last n-k 
bits out of the shift register cell F Q will be the check 
digits. After (n-l)^ h clock pulse the contents of shift 
register cells repeat, n defines the code length and it is 
called the period of the shift register. 
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The characteristic polynomial of the [T] matrix (character- 
istic matrix) is defined by; 

ff(x) |t - I xj = x k +g k . 1 x k - 1 + gk _ 2 x lc -2 + . . . + Sl x + g 0 



The generator polynomial of the code G(x), in general j2f(x) 

¥ G(x), which is characteristic polynomial 0(x) is higher in 
degree than generator polynomial G(x) . However if character- 
istic matrix [t] is in the form of given above, characteristic 
polynomial 0(x) is equal to generator polynomial G(x) . Given 
a characteristic matrix [Tj , G(x) can be used to define the 
code uniquely. Example Is If characteristic polynomial is 
chosen as 

G(X) = X 4 +X+l 

which is G(X)=X 4 +g 3 X 3 +g 2 X 2 +g 1 X+l 

gj = gg = 0 switches are open, k-stage feedback shift register 

becomes as shown in Figure 

At t=0 if the message 0001 put in shift registers 

the contents of shift registers will follow the period shown 

in Figure 5- Since the period of the characteristic matrix 

4 

or the characteristic polynomial is fifteen, G(X) = X +X+1 
generates the code with four information digits (power of 
characteristic polynomial is four) and eleven check digits. 

The given characteristic polynomial has the period 2 -1 - 15 > 
therefore it is called the maximum period polynomial or irre- 
ducible polynomial. Since the period of generator polynomial 
is fifteen it divides the polynomial X' 1 " 3 +l (in modulo 2). 
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Output 
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G(x) 




Numbers in the circles are the decimal representation 
of what is in the shift registers at t = t^. 



Figure 5* Cycle set of generator Polynomial 
G(x) = x^+x+l. 
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The check polynomial of the same code is defined by; 

H(X) = — — 1 — = X i:L +X 8 +X 7 +X^+X 3 +X 2 +X+l 

G(X) 

The coefficients form a code word, namely 000100110101111. 

The code generated by the given polynomial is a (15,4) code. 

The code is cyclic, therefore any cyclic shift of the check 
polynomial is another code word and any linear combinations 
of code words is also another code word. Since the generator 
polynomial G(x) is irreducible, fifteen cyclic shifts of the 
check polynomial is a code word and the code alphabet has 
4 

2 = 16 words (including the zero word) . To represent the 

code alphabet 15 cyclic shifts of the coefficients of the check 
polynomial defines the all non zero alphabet letters. 

Example 2: Let the generator polynomial be chosen as 

G(x) = (x^+x+l) (x^+x^+x 2 +x+l) = x 8 +x 7 +x 8 +x^+l 

The k-stage shift register becomes as shown in Figure 6. If 
at t = 0 the message 00000001 is put in shift register cells, 
the contents of the register will follow the period shown in 
Figure 7» The generator polynomial has the degree eight, 

O 

therefore number of code words are 2° = 2 56 ( including the 
zero word), and the period of the polynomial is 15* This 
polynomial (being a reducible polynomial) has ( 255 / 15 ) - 17 
non trivial cycle sets and one trivial zero cycle (the zero 
word). Since the period of the polynomial is 15 (the word 
length), G(x) divides x^+l (in modulo 2) the check polynomial 
of the code is 



25 



-p 

3 



3 

O 




in 

-p 

3 

PH 



•H 

e 

o 
C 
>> 
i — i 

o 

PH 

U 

o 

•P 

ctf 

U 

CD 

c 

Q) 

o 

u 

o 

pH 

p 

0) 

•P H 
C/2 + 

•H j3* 

bn x 

CD + 
C£M3 

*P 

ch £> 
& 

m a 

CD 
UD 
ctf 
-P 

in 

i 

>4 



\o 



CD 

P 

W) 

•H 

P^4 



26 



G(x) = x+x' + x 



Trivial Cycle 



Numbers in the circles are the decimal representation 
of what is in the shift registers of t = t^ 



Figure 7* The two cycle sets out of 17 of the generator 
polynomial G(x) = x^+x^+x^+x^+l 



H(x) = — — — = x^+x^+x^+1 

G(x) 

The coefficients form a code word, namely 000000011010001. 

Any cyclic shifts of this code word is another code word, 
but by simply shifting it one can get only fifteen different 
code words. The code alphabet has 2 1 '*-1 = 255 (excluding the 
zero word) words, the other code words can be obtained by 
linear combinations of the 15 cyclic shifted code words. 

Since the generator polynomial given in this example is 
reducible, there is more than one maximum cycle (actually all 
the cycles have the same cycle length of 15, excluding the 
zero trivial cycle) . The code generated by this polynomial is 
a (15,8) code. In the case where the number of check digits 
less than the number of information digits, choosing the 
shift register based upon the number of check digits (m-stage 
feedback shift register^ Ref. 5 page 22J>7) will simplify the 
encoder design. 

2. Computer application of encoder : 

Since the whole encoding operations were done with the 
aid of a computer (DEC PDP - ll/4o) , this section describes 
how easy it is to implement encoding operations with a computer. 
Encoder program used in this thesis just incorporates a matrix 
multiplication of the message word by the generator matrix 
described below. 

The coefficients of the check polynomial H(x) is a code 
word and any cyclic shifts of this coefficients is another code 
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word. One can define the generator matrix as one whose rows 



are code words. Such a generator matrix is in the form of: 



T k,n 



1 0 0 0 . . h 

0 10 0 h 

0 0 10 . . h 



H 

l 

O 


h 0 , k-2 


O 

O 


l,k-l 


h l,k-2 


O 

H 


2 ,k-l 


h 2,k-2 


”■ h 2,0 



0 0 0 0 . . 1 



x k-l 



... h. 



Any source encoder output message when multiplied by this 
matrix, gives the encoded w ord as a result. If the encoded 
word is defined by ^ and the input message to the error 

correction encoder is defined by a ^ matrix 




This is the easy and fast way to encode the messages. 

By changing the rows of the generator matrix [o] k,n ’ as for 

a different code, the encoder will be changed to one for the 

different cyclic code. To change the rows of the generator 

matrix ]G , one has to define the coefficients of the check 
l Jk,n 

polynomial H(x) for the new code, this is easy to do for 
any given code. Example 3 5 Generator matrix of the code 
( 15 , 4 ) 
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100010011010111 
r r i _ 010011010111100 

L Jk.n 001001101011110 
000100110101111_ 

Let [x] x k = [o 0 1 ij 

After multiplication by the generator matrix, the encoded 
word becomes 

n =[0 0 1 1 0 1 0 i i 1 1 0 0 0 l] 
this is the modulo 2 addition of last 2 rows of the generator 
matrix [g]^. 

The encoder program described by the flow chart shown in 
Figure 8 performs the matrix multiplication of the message 
word by the generator matrix. The operations used in the 
flow chart involved the following notations: 

MOV = move 

CLR = clear 

ASL = arithmetically shift left 
BCC = branch if carry is clear 

XOR = exclusive or 

SOB = substruct one and branch if the result is 

not equal to zero 
RO = register # 0 

Rl = register #1 etc. 

(RO) = contents of register # 0 

(w) = contents of address w 

HLT = halt 

(R0)+ = increment contents of register # 0 (RO) by two 
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Figure 8. Cyclic Encoder Flow Chart. 
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The message digits are stored in a block in the form of ASCII 
code . 

The starting address of information message to be encodes is in 
RO. 

The starting address of encoded word is in Rl. 

The number of information characters to be encoded is in R2. 

The starting address of rows of generator matrix is in address(g). 

k is the number of information message bits. 

D. CYCLIC DECODER 

1 . Minimum Distance Decoder 

The Hamming distance is defined by the minimum number 

of different digits between 2 code words. 

Example: The Hamming distance between the following 2 code 

words 

000100110101111 

010011010111100 

is 8. If any combinations of (— ^~) or less erros occur in 
a received code word, the distance of this perturbed code 
word to the original transmitted word is less than the other 
original alphabet letters. For the code above if three or 
less errors occur in one word the distance of this noisy word 
to the actual transmitted word is three or less but the distance 
to the other code words is five or greater. 

Example : 

original transmitted word : 001001101011110 
error sequence : 001000100000100 

received word : 000001001011010 
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The distance (d^) between this received word and some of the 
other words is as follows: 

Code alphabet: 000100110101111 001001101011110 000000000000000 

received word: 

000001001011010 d x =9 d 2 =3 d^=5 

Using the fixed properties of irreducible polynomial codes, 
if the received word is not in the alphabet set, the decoder 
takes the code word which has a distance to this received word, 
which is equal to or less than d/2, as a decoded word. 

For the code given by the coefficients of the 

H(x) = x^+x°+x^+x^+x^+x^+x+l , the Hamming distance is 8. 

One expects any combinations of three or less errors will be 
decoded correctly. Due to Varsharmov - Gilbert-Sacks condition 
(upper bound) for the (15.4) code e = 4- does not satisfy the 
inequality. In experiments it is found that out of 1365 
different combinations of 4 errors 926 four errors can be 
corrected. Minimum distance decoder for any irreducible 
polynomial can be constructed as shown in Figure 9- 
2. Operation of Minimum Distance Decoder 

Starting from time t = 0 the received word is fed bit 
by bit to the shift register A. Register C has the coefficients 
of the check polynomial H(x) in binary representation, regis- 
ter D contains all zeros. At time t = n-1 register A will 
have the whole word [w+zl . Where [wl-. is the original 

J 1 j II - 1 -L j II 
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transmitted word fzl n „ is the noise due to the channel. After 
time t = n-1 gate #1 opens and the contents of register A 
enters register B. Since register C contains the coefficients 
of the check polynomial and every cyclic shift of this poly- 
nomial is another code word, the corresponding bits of register 
B and C are added (modulo 2) . If the resulting number of 
ones after addition in modulo 2 is greater than d/2 (indicating 
the Hamming distance between registers B and C is greater than 
d/2), the contents of register C will be shifted right and 
the corresponding bits of registers B and C are added together 
again to check if the resulted number of ones are less than 
or equal to d/2. Note that as each clock pulse shifts register 
C a new digit of the next word to be decoded is shifted into 
register A therefore after n shifts of register C, register 
A will contain the complete code word, thus the decoding process 
is continuous. If during any one of the checks between 
registers B and C, the resulting number of ones is equal to 
or less than d/2, gate #2 opens and contents of register C 
will be transferred to register D as a corrected word. How- 
ever, if for any of the n clock pulses none of the additions 
result in d/2 or less number of ones, the cleared contents of 
register D (the zero word) will be taken as the corrected word. 
At t = n-1 register A has the next received word jw + z 3i n’ 
gate #1 opens and contents of register A enters the register 
B, register D is cleared and another cycle begins. As a 
property of cyclic codes if a received word has a distance 
less than d/2 to the original transmitted word (code alphabet) 
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it can not be simultaneously that closer to another code word 
of the code alphabet. After one word is decoded, there is 
no need to continue the modulo 2 additions between registers 
B and C until the next received word has been completely 
shifted into register A . 

When a reducible polynomial is used for the generator 
polynomial, such as G(x) = x^+x^+x^+x^+l = (x^+x+l) (x^+x^+x 2 +x+l) 
and with check polynomial H(x) = x^+x^+x^+1, all the cyclic 
shifts of the coefficients of the check polynomial H(x) is 
not enough to represent all of the possible code alphabet 

O 

letters. Since the given (15.8) code cited above has 2-1 = 255 

possible words (excluding the zero word), and since all the 

periods of the generator polynomial have length 15 (except 

the zero trivial cycle) one needs (255/l5) = 17 register C's 

(as described in Figure 9)* With the different code words 

belong to the different cycle sets shown in Figure 7- Because 

as a property of cyclic codes, one code can be defined as a 

linear combinations of others and because the rank of generator 

matrix TgI, is 8, it can be shown the number of register C's 
J K , n 

can be reduced to 8, instead of 17- 

The flow chart shown in Figure 10 performs the modulo 2 
addition between registers C and B to check the distance 
between original word and the received word to see if the 
distance is equal to or less than d/2. When the condition 
is met the contents of R3 is taken as the decoded word. 
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Figure 10 . 



Minimum distance decoder flow chart (for 
irreducible polynomial) . 
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The notation used for the minimum distance decoder is 



the same used for the encoder flow chart. 



The starting address of received word is in RO 
The starting address of decoded information word is in R1 
The number of received messages is in R2 
The parity check polynomial is in (h) 

The number of word bits is n 



3 . Computer decoding using the syndrome method 

Another decoding system is achieved by using a decod- 
ing table stored in the computer's memory. In computer appli- 
cation of encoder section, the generator matrix for any code 
is defined by: 



1 


0 


0 


0 . . 


. 0 


h l,k-l 


h l,k-2 * 


* * h l,0 


0 


1 


0 


0 . . 


. 0 


h 2,k-l 


h 2,k-2 • 


* * h 2,0 




0000 . . 1 h k _ 1 h ^.2 • * * h o 



The check matrix of the 



same code can be represented as: 
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[h] 



n, m 



h l,k-l h l,k-2 • ' • 



h 2,k-l h 2,k-2 * 



k-1 

1 

0 



k-2 

0 

1 



1,0 



‘ 2,0 



0 



0 



0 

0 



0 



0 



0 






Matrix multiplication of any original code word by the check 

matrix will result in a To] , matrix 

L J 1 , m 

[wi [hi = rol, 

L - 1,11 L Jn,m L Ji,m 

However if any error present in the received code word the 

result will not be the [o] matrix, 

u J 1 , m 

[w + z] [h] = [w] [hJ + [zj. [h] 

L J l,n LJ n,m L J l,n LJ n,m LJ l,n LJ n,m 



= [o] , = [z ] 1 [lH ~ [sl , 

LJ l,m L J l,n LJ n,m L J l , m 
The matrix [sj-^ m is called the syndrome. For every error 
pattern fzl , has a unique syndrome [s] , . By simply 

listing the correctible error patterns and versus their 
syndromes in table stored in the computer, one can find the 
error pattern readily after the syndrome has been found by 
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matrix multiplication of received by check matrix. The error 
pattern when exclusive OR'ed with the received word yield to 
most probable transmitted word. 

E w+ z ]l,n + Hi.n = Hl,n (modul ° 2 > 

Restated step by step: 

(1) List all of the possible syndromes [s] and 
error patterns [zj ^ n (or the other name is 'corrector') due 
to given syndrome 

(2) Multiply the received word by check matrix to 
obtain the syndrome . 

(3) From decoding list, get the corrector due to 
obtained syndrome 

(4) Add this corrector to the received word in 
order to correct the errors 

Example: The alphabet of code generated by polynomial 

G(X) = X 4 +X+l 

is given by the ^V\fj n matrix (one cycle of register C) 
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1 0 
0 1 
0 0 
0 0 
1 1 
1 0 
1 0 
0 1 
0 1 
0 0 
1 1 
1 1 
1 0 
0 1 
1 1 



0010011010111 
0011010111100 
1001101011110 
0100110101111 
0001001101011 
1011110001001 
0110101111000 
1010111100010 
0111100010011 
1101011110001 
10 0 0100110101 
0101111000100 
1111000100110 
1110001001101 
1100010011010 



m- 



The last "m" columns of [W] n matrix gives the syndrome of 
corresponding corrector of first "k" columns (error pattern). 



Example : 

Syndrome {s] 1>m 

10011010111 
00011010111 
10011100111 



Error pattern [zQ ^ ^ 

100000000000000 

100010000000000 

100000000110000 



As one sees any additional errors in the check digits yield 
a corresponding digit changed in the syndrome, this property 
of syndromes make the decoding table easier and shorter. 

To make up the decoding table, first list the error patterns 
L z]i n according to their weight using the [wj n n matrix and 
list the corresponding syndromes. Since one only needs to 
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correct the errors in the information digits, it is enough to 
add the first k digits of error pattern [z] n to corres- 
ponding digits of received word. 

4. Syndrome method decoder flow chart (Figure 11) 

First syndromes and error patterns (correctors) assumed 
listed in memory. The program multiples the received word by 
check matrix \j-fj n m and result is the syndrome m matrix 

from this syndrome, listed error pattern are obtained and 
added to received word for correction (in modulo 2) 

The starting address of received word is in RO 

The starting address of decoded information words is in R1 

The number of received message is in R2 

The starting address of syndromes is in memory address "a" 

The starting address of correctors is in memory address "b" 

The starting address of the row's of parity check matrix 
is in memory address "h" 

"n" is the number of code word bits. 

Additional notation used is given below 

TST = test address 

BEQ = branch if equal to 

COMP = compare two addresses 
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Figure 11. Syndrome Method Decoder Flow Chart. 
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III. CHANNEL NOISE 



Channel noise simulation by the computer can he described 
in two parts, (1) generation of random numbers (2) generation 
of noise sequence. 

(1) Generation of random numbers 

Random numbers generated in this program were obtained 
by using the Lehmer congruential method. 

x n+1 = a x n + b (modulo T Q ) 

Letting a = 257 > b = 3. the starting number x Q is chosen as 
a prime number and changed for each sequence, T^ = 2^ (all 
in decimal) . Therefore the period of the random number seq- 
uence is 2^. After the generation of the random numbers, 
every k^ h of them is taken as a selected random number, where 
K is called the indexing factor which we shall see, related 
to the channel )A in the binary symmetric channel (Figure 2) . 

The selected random number is taken to specify the address of 
a random number field, and a marker *1' is put in to this 
address . 

(2) Generation of noise 

The markers put in the random number field were taken 
to designate the ones in a sequence of zeros and ones, the 
sequence has a one to one correspondence to the random number 
field. The resulting sequence is exclusive OR'ed with success- 
ive words of the encoded message, thereby simulating the 
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introduction of error bits. Word corresponding to carriage 
return was given noise immunity, but in the probability of 
error calculations, the number of carriage returns were sub- 
tracted from the number of inputs . 

Figures from 12 to 16 represent the actual and binomial 
distribution of errors due to the indexing factors K used. 

The J2-’s is taken as a probability of an error (or a 1) and 
is calculated by counting the number of ones out of 153000 
bits (in decimal). It is found that the simulated noise 
sequences more or less closely follow the binomial distribution 
except for K equal to powers of 2. It is helpful to point out 
that for any binary symmetric channel is very closely related 
to signal to noise ratio (S/N). 

The channel used in this thesis is a memoryless binary 
symmetric channel. Memoryless channel is the one which noise 
doesn't depend upon the previous-in time - value). Binary 
symmetric channel is the one which the probability of bit 
zero to change the bit one is equal to the probability of bit 
one to change the bit zero. Table I represents some indexing 
factors K versus binary symmetric channel p's. 

A. FLOW CHART DESCRIPTION OF NOISE PROGRAM (Figure 1?) 

This program describes the generation of random numbers to 
put into random number field by the Lehmer congruential method. 
After this program one can combine the markers according to 
it's word length (code length). Additional notation used in 
the flow chart: 
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Figure 12. Simulated Noise (K=3, ? = 0.26613) 
vs. Binomial Distribution. 
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Figure 13- Simulated noise (K=5» ]3=0. 1?032) 

vs. Binomial Distribution. 
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Figure 14. Simulated Noise (K=6, p =0.13992) 
vs. Binomial Distribution. 
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Figure 15* Simulated Noise (K=7» f* -0.12526) 
Vs. Binomial Distribution. 
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Figure 16. Simulated Noise (K=9 J3 = 0.097973) 
vs. Binomial Distribution. 



Indexing 


Channel 


Factor(k) 


z 3 


? 


0.26613 


5 


0.1709 


6 


0.13992 


7 


0.12521 


9 


0.09797 


10 


0.0945 


11 


0.0859 


12 


0.07506 


13 


0.07050 


15 


0.063242 


18 


0.052187 


21 


0.04561 


24 


0.03855 


29 


0.032961 


36 


0.026429 


41 


0.023132 



Table I. Indexing Factor K vs. Channel )3 . 
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Figure 17 . Flow Chart of the Simulated Noise Program. 
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MULT = multiply 

ADD = add 

DEC = decrement 

BEQ = branch if the result is equal to zero 

K is the indexing factor (defines p for binary symmetric 
channel 

n is the word length 

Xq is the starting prime number 

The starting address of random number field is in RO 
The starting address of noise field is in R5 
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IV . BEST CODE DE TERM I NAT I ON 



The noisy channel theorem £~ Ref . lj\ Let a discrete 
channel have the capacity C bits/sec. and a discrete source 
has the entropy per second H. If H there exists a coding 
system such that the output of the source can be transmitted 
over the channel with an arbitrarily small frequency of errors. 
If H^>C, it is possible to encode the source so that the 
equivocation is less than H-C+^ where is arbitrarily small. 
There is no method of encoding which gives an equivocation less 
than H-C. The discrete source entropy for long messages 
consisting of discrete symbols is given by 

H(x) = - ^ Pj^ log p i 
i=l 

where p^ is the probability of occurrence of a given symbol, 
in the above formula it is assumed that the each new symbol 
is independent of the proceeding ones. In the situation where 
the symbols are transmitted over a noisy channel a given symbol 
x^ may be received as y^ . Shannon's measure of equivocation 
or uncertainity at the receiver is to what was actually 
transmitted is defined as: 

H(x/y) = 2 2 p ( x i* lo S P(x i /y i ) 

For the binary symmetric channel where the )3 is a conditional 
probability of an error being made in the channel 

H(x/y) = logJP> + ( 1- ) log (1-p) 
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Then the channel capacity 

C = H(x) - H(x/y), 
maximized for H(x) . 

In the following discussion the probability of error will 
be used instead of equivocation, the two concepts were closely 
related but the probability of error is more convenient. 

For clearity y and P(e) will be defined here as follows: 
j£> = P(0/1) = P(l/0) for the channel 



note that in the case of ASCII characters where each character 
is represented by 8 binary digits, less than the total number 
of digits representing the ASCII character may be coded into 
a single word or on the other hand one or more ASCII characters 
plus a fraction of a character might be coded into a word. 

A 'best code' means one that least probability of error 
for any given channel J3 and highest rate R=k/n. The error 
correction ability of the code can be derived from the 
Varsharmov - Gilbert - Sacks condition 



and closely related to rate R of the code. After definition 
of the code rate R, and word length n one can find the 
number of correctible e- tuple errors from Varsharmov - Gilbert - 



number of wrong decoded words 



total number of words 




2e-l 
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Sacks condition . The theoretical value of probability of 
error is given by /~Ref . 3_J7: 




where is the number of correct ible e-tuple errors, where 

e^=0,l,2,.., up to the maximum number of correctible errors 
per word. 

The Hamming distance (d) as defined earlier is the minimum 
distance between code words. If d happens to be even and 
the maximum value of e is given by (d-l)/2, this will 
yield a fraction. Then number of maximum e^- tuple errors 
is given by /~Ref. 4J7. 



number of correctible d/2 errors 
total number of d/2 erros 



u ( u+ 1 ) 




where u 




Reduction in the probability of error, keeping the channel 

constant, results also in a reduction of the code rate. By 
working backward, for any given probability of error and word 
length, (for a given channel y> ), from the Varsharmov - Gilbert 
Sacks condition and the theoretical value of probability of 
error equation, one can find the information length and code 
rate. Figure 21 to be described in the conclusion section 
relates , rate R and the probability of error. 
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V. RESULTS 



Three different code rates vs. different channel JS's 
were examined in this thesis. To get the probability of 
error, approximately 40000 words were mixed with noise for 
each given binary symmetric channel J6> . For a (15,4) code 
(Rate R = 4/15) » “two different decoding systems (Minimum 
distance decoder and syndrome method decoder) and two different 
generator polynomials G(x) were used to find the probability 
of error. 

Table II represents the probability of error vs. channel 
p ' s of the code (15.4) for two different generator polynomials 
and two different decoding systems. Probability of errors 
for those systems and for different generator polynomials for 
given channel p's are in the limits of “t 1% difference. 

This means that for any given code rate, the minimum distance 
decoder and the syndrome method decoder gives the same prob- 
ability of error. Furthermore using other generator polynomials 
of the same rate does not change the probability of error. 

Figure 18 shows the three dimensional representation of 
the (15.4) code. 

Figure 19 shows the three dimensional representation of 
the (15.8) code using the syndrome method decoder. As one 
sees the shape of the P(e) vs. j3 curve is a S-shaped. As 
£ increases, P(e) approaches 1.0 as a limit. 
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Channel 

P 


P.(e) 

G(X)=x4+x+ 1 Min. 
Distance Decoder 


P(e i n 

G(X)=x rx-'+l Min, 
Distance Decoder 


r p(e i 1 

, G(X)=X 4 +x+ 1 
Syndrome Decoder 


0.07050 


5.4480 x 10" ^ 




i 


0.09797 


2.9176 x 10" 2 


3.176 x 10" 2 


2.655 X 10" 2 


0.12426 


6.2425 x 10" 2 


5.795 x 10" 2 


5.817 x 10“ 2 


0.13992 


1.2542 x 10" 1 


1.0479 x 10" 1 


1.1442 x 10" 1 


0.1709 


I. 878 O x 10" 1 


1.885 x 10" 1 


1.778 x 10" 1 


0 . 26613 


4.9052 x 10 -1 


4.878 x 10" 1 


4.8309 x 10" 1 



Table II. P(e) vs. Channel y> f or the code (15>4). 



P(e) 



Q) 

■P 
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•I+x+ x = (x)0 
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Figure 20 shows the three dimensional representation of the 
(21,16) code using the syndrome method decoder. The shape of 
the P(e) vs. )2> curve is also S-shaped, but the steepness of 
the curve is much greater than for the (15,8) P(e) vs . 
curve . 

Tables III and IV shows the probability of error versus 
channel 's for the codes (15,8) and (21,16) respectively. 
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Channel 


P(e) 


0.023132 


0.0433 


0 .03855 


0.07396 


0.04561 


0.09803 


0 .052187 


0.13573 


0.063242 


0.17932 


0.07050 


0 . 20790 


0.0859 


0 . 27170 


0.097973 


0.35667 


0.12526 


0.48701 


0 .13992 


0.54223 


0.1709 


0 . 6636 


0.26613 


0.90378 



Table III. P(e) vs. Channel Beta for the Code (15.8). 
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Channel 


P(e) 


0.023132 


0.11446 


0 . 026429 


0.13227 


0.032961 


0.14298 


0 .03855 


0.18854 


0 .04561 


0.25066 


0.05218 


0.31940 


0.06324 


0.39899 


0.0?506 


0.51879 


0.0943 


0.61530 


0.12526 


0.80895 


0.13992 


0.86483 


0.1409 


0.94532 



Table IV. P(e) vs. Channel Beta for the code 
(21,16) . 
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VI. DISCUSSION AND CONCLUSIONS 



Two different type of decoder (syndrome method and 
minimum distance decoder) discussed in this thesis give 
the same probability of error for the same channel J3 . For 
the irreducible polynomial code the minimum distance decoder 
is faster than the syndrome method decoder. For the (15,4) 
code the number of syndromes are S(x) = 2"^ - ^ = 2^ = 2048 
with the same number of correctors (error patterns). After 
multiplication of the received word by the parity check matrix, 
the result (syndrome [s] , ) will be checked if it is equal 

_L | III 

one of the 2048 syndromes previously listed in the computer 
memory in order to find the corrector. But for the 
same irreducible polynomial code (15,4) there is only one 
maximum cycle set; therefore the received v/ord will be checked 
if it is in distance d/2 or less to these 15 words, and so is 
much shorter in time than the syndrome method decoder. On 
the other hand, for the reducible polynomial code (21,16), 
there are = 2^=32 syndromes and the same number of 

correctors (error patterns). After multiplication of the 
received word by the parity check matrix H(x) , the result 
(syndrome [Cl q m ) will be checked if it is equal to one of 
the 32 syndromes previously listed in the computer memory, to 
find the corrector. But for the same reducible polynomial 
there are 2^/21 = 3121 maximum cycles length of 21 (excluding 
zero trivial cycle) . Therefore there are 3121 x 21 = 65536 
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words to be checked if the received word is in d/2 distance 
apart from those words, which is much longer in time than 
the syndrome method decoder. As a result one can predict 
for any given code (n,k) from the number of syndromes and 
number of maximum cycles for the minimum distance decoder 
which method is shorter in time. 

For any given code (n,k) , sometimes there is more than 
one generator polynomials, then the probability of error 
results do not depend upon the polynomial being used for 
any specific word length and information length (See tabulated 
results for (15.4) code in Table II). 

The shape of the P(e) vs. channel j3 curve for any given 
code rate is an S-shaped curve: the greater the code rate 

the steeper the S-shaped curve. Figure 21 combines the cal- 
culated probability of errors for the 3 different codes, were 
investigated. For any given channel and permissible pro- 
bability of error one can obtain the maximum code rate 
from the given figure above. 
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APPENDIX A 



Program flow: 

1. Noise program; First generates random numbers and put 
a marker "1" due to random number in the random number field 
between memory addresses 57000 - 77776. Second combines the 
markers in the random number field according to word length 
and puts the resulted noise between memory addresses 32000- 
32400. Noise program starts at address 10000, end of the 
program at the address 10212. 

2. Input program; Takes the input messages and puts 
addresses between 51000-52000 in sequential order. Location 
(50100) counts the number of input messages. Input program 
starts at address 20000, end of the program at address 20122. 

3. Encoder; 

A. Encoder for the (15,4) code; Takes the input 
messages between addresses 51000-52000, encodes and puts 
between addresses 52000-54000 . Generator matrix is in addresses 
between 50200-50206, location (50140) is used for ASL, (50142) 
is used for encoding operations. Program starts at address 
20124, end of the program is at 20240. 

B. Encoder for the (15,6) code; Takes the input 
messages between addresses 51000-52000, encodes and puts 
between addresses 52000-54000. Generator matrix is in addresses 
between 20610-20626, location (50104) is used for encoding, 
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(50102) is used for ASL operations. Program starts at 
address 20124, end of the program is at 20204. 

4. Noise mixing sequence; Adds the noise between addresses 
32000-32400 to the encoded messages between addresses 52000- 
54000 (in modulo 2). Carriage return has the noise immunity. 
Noise mixing sequence for the code (15,4) is between 20242- 
20332, for the code (15,8) is between 20206-20250. 

5* Decoder; 

A. Syndrome method decoder for the code (15,4); Takes 
the transmitted message mixed with noise from the addresses 
between 52000-54000, decodes, corrects the errors if they 

are correcible and puts the addresses between 56000-57000. 
Parity check matrix H(X) is between addresses 50210-50244, 
syndrome S(X) is between 50246-50304, corrector (error pattern) 
2(X) is between 50306-50340. 

B. Minimum distance decoder for the code (15,4); 

Takes the transmitted message mixed with noise from the 
addresses between 52000-54000, decodes, corrects the errors 
if they are correctible and puts the addresses between 56000- 
57000. Register C described in Figure 9 is in address (50104). 

C. Syndrome method decoder for the code (15,8); 

Takes the transmitted message mixed with noise from the 
addresses between 52000-54000, decodes, corrects the errors 
if they are correctible and puts the addresses between 56000- 
57000. Parity check matrix H(X) is in addresses between 20630- 
20664, corrector (error pattern) Z(X) is in addresses between 
20666-20774, syndrome S(X) is in addresses between 20776-21104. 
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6. Output program; Takes the decoded message from 
addresses 56000-57000 and writes it out, program is in address- 
es "between 20704-21000 for the code (15,4) minimum distance 
decoder, 21506-21604 for the code (15,4) syndrome method 
decoder, 20406-20502 for the code ( 15 , 8 ) syndrome method 
decoder . 
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APPENDIX B 



NOISE PROGRAM ADDRESS 10024 HAS THE STARTING 
RANDOM NUMBER ADDRESS 10020 HAS THE INDEXING 
FACTOR. 



010O00 


70127O0 


W 




010002 


7O2200O 


010120 


7060014 


010004 


70127O1 


• 010122 


7012774 


010006 


7B010O0 


010124 


7 O O 0 O 0 1 


010010 


7 O O 5 O 2 O 


010126 


7 O 0 O 0 O O 


010012 


7O77102 


. O1O140 


70OO75O 


010014 


7OOO240 


010142 


7 0 0 5 G 2 6 


01OO16 


7012700 


010144 


701270 O 


01OO20 


7 0 5 7 0 O O 


01O146 


7O57OO0 


O10O22 


7012746 


018150 


7012701 


O1O024 


7 012 7 0 5 


010152 


7 0 2 2 0 O O 


0 1 0 O 2 6 


7012746 


010154 


70127O2 


01OO2O 


7 0 0 O O 2 O 


01O156 


700O177 


O1O022 


7 0 1 1 6 6 7 


0101 6 0 


7012702 


010O24 


700OO26 


O10162 


7O00O2O 


O1O026 


7012704 


01O164 


7 O 06 22 O 


010040 


7177204 


010166 


7 0 B 6011 


010042 


7012714 


O1O170 


7077202 


010044 


7O10000 


010172 


70O5721 


01O046 


7012627 


010174 


7 012 7 0 2 


010050 


717720B 


O10176 


70OO005 


0 1 0 O 5 2 


7 0 1 1 4 6 7 


010200 


7 0 0 6 2 2 0 


01OO54 


7 0 O 0 0 2 0 


010202 


70O6011 


01OO56 


7 0 1 2 7 0 1 


01O2O4 


7077202 


01OO6O 


7177216 


010206 


7005721 


010O62 


7012702 


010210 


7077215 


010064 


7 0 0 O O 2 O 


01O212 


7 0 0 0 0 0 O 


01OO66 


7012624 


* 




010070 


7012714 






010072 


7O0O401 






010074 


7014446 






01O076 


7062716 






O10100 


7 0 O 0 0 O 2 






010102 


7077207 






010104 


7005227 






010106 


7000000 






010110 


7001414 






010112 


7 0 1 1 6 1 4 






010114 


7005044 






010116 


7012711 






010126 


7177775 






010122 


7 0 0 5 7 2 4 






D10124 


7042714 






01O126 


7 O O 0 0 0 1 
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APPENDIX C 



INPUT PROGRAM ADDRESS 50100 HAS THE NUMBER OF 
INPUT MESSAGES 

The character @ defines the end of the program 



M 


■ 


020000 


7012700 


020002 


7051 0 0 0 


020004 


7 0 0 5 0 0 2 


02000 e 


7105737 


020010 


7177560 


020012 


7100375 


020014 


7113710 


020016 


7177562 


020020 


7122710 


020022 


7 0 0 0 3 0 0 


020024 


7 0 0 14 32 


020026 


7005202 


020030 


7105737 


020022 


7177564 


020O24 


71G0375 


02G026 


7111037 


020040 


7177566 


020042 


7122720 


020044 


70D0215 


020046 


70O14O1 


020050 


7000756 


O20052 


7012701 


020O54 


7 0 0 0 0 1 2 


020056 


7105737 


020060 


7177564 


020062 


7100375 


O20064 


7112737 


02006 6 


7 0 0 0 2 0 0 


02007 0 


7177566 


02O072 


7077107 


020074 


7105737 


0 2007 6 


7177564 


020100 


71O0375 


020102 


7112737 


020104 


7000212 


O20106 


7177566 


020110 


7 0 O 0 7 36 


020112 


7010237 


020114 


7 0 5 010 0 


020116 


7005000 


020120 


7 0 0 5 0 0 2 


02O122 


7 0 0 0 0 0 0 



* 
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APPENDIX D 



ENCODER FOR THE CODE (15,4) 

ROWS OF GENERATOR MATRIX G<X) IN ADDRESSES BETWEEN 
56200 -502O6 



w 




020124 


/ 0 1 2 7 0 0 


020126 


✓051000 


O20120 


✓ 0 0 0 2 4 0 


020122 


/ 0 0024 0 


02O124 


✓013702 


020126 


/ 0 5 0 1 0 0 


02014O 


✓112037 


020142 


✓ 05014 £t 


02G144 


✓ 012 7 0 3 


020146 


✓ 0 00002 


02O150 


✓012704 


02O152 


✓ 0 0 0 0 0 4 


02O154 


✓012705 


020156 


✓050200 


020168 


✓005037 


O20162 


✓ 050142 


020164 


✓012501 


020166 


✓106337 


02O170 


✓050140 


020172 


✓1030O2 


02O174 


✓074137 


020176 


✓05O142 


020200 


✓000240 


02O202 


✓077410 


020204 


✓013737 


020206 


✓050142 


020210 


✓052000 


020212 


✓005237 


020214 


✓020210 


02O216 


✓005237 


020220 


✓02021O 


020222 


✓077326 


O20224 


✓077233 


020226 


✓012737 


020236 


✓052000 


020232 


✓02021 O 


02O234 


✓000000 



* 
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ENCODER FOR THE CODE <15, 8) 



w 

020124 


7012700 


02O126 


705100 0 


02012O 


7012701 


02O122 


7052000 


02O124 


7012702 


020126 


705010 O 


02014O 


7112027 


02O142 


705O10 2 


02O144 


7012702 


02O146 


7020610 


02015O 


7012704 


020152 


7 0 0 0 0 1 0 


02O154 


7 0 0 5 O 2 7 


02O156 


7 0 5 010 4 


02O160 


7 012 2 O 5 


02D162 


710S227 


020164 


7 0 5 0 1 0 2 


020166 


7 1 0 2 O 0 2 


02O170 


7 074 5 2 7 


020172 


7050104 


020174 


7077407 


0 2 0 1 7 6 


7012721 


020200 


7050164 


0202 O 2 


7077222 


020204 


7O00240 


* 





/ 
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APPENDIX E 



NOISE MIXING SEQUENCE FOR THE CODE (15,4) 



w 




020242 


✓012700 


020244 


/ 0 5 2 0 0 0 


020246 


✓012701 


020256 


✓022000 


020252 


✓012702 


020254 


.✓050100 


020256 


✓062702 


0 2 0 2 6 O 


✓05O100 


020262 


✓O22027 


020264 


✓104656 


020266 


✓ 001 0 0 5 


020220 


✓022027 


O20222 


✓ 1 5 2 6 1 0 


020224 


✓001010 


020226 


✓077207 


02O2O0 


✓000414 


020202 


✓005740 


020204 


✓011002 


0202O6 


✓074211 


020210 


✓01212O 


020212 


✓077215 


020214 


✓ 0 0 0 4 0 6 


02O216 


✓005740 


020220 


✓005740 


020222 


✓011002 


020224 


✓074211 


020226 


✓012120 


020220 


✓077224 


0.20222 


✓000000 



♦ 
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NOISE NIXING SEQUENCE FOR THE CODE <15,0) 



W 

02O206 
020210 
020212 
020214 
020216 
020220 
020222 
020224 
020226 
020220 
0 2 0 2 2 2 
020224 
020226 
020240 
020242 
020244 
020246 
02G250 
♦ 



/ 0 0 0 2 4 0 
2000240 
2 0 0 0 2 4 0 
2 0 0 0 2 4 0 
2012700 
20520O0 
2012701 
2022000 
2012702 
2050100 
2021027 
210 6 7 O 0 
2001402 ' 
2012102 
2074210 
2005720 
2077207 
2000240 
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APPENDIX F 



SVHDROME METHOD* DECODER FOR THE CODE (15,4) 



W 



020224 


7012700 


W 




020226 


7 0 5 2 0 0 0 


020466 


7012702 


020 24 0 


7 0 0 0 2 4 0 


02O470 


7 0 0 0 0 1 2 


020242 


7 0 0 0 24 0 


020472 


7012705 


020244 


7012727 


020474 


705O250 


620246 


7050100 


020476 


7012704 


02O250 


7050102 


O205O0 


7050206 


02O252 


7012727 


020502 


7012727 


020254 


7 0 0 0 0 0 2 


020504 


7000016 


020256 


7050104 


0 2 O 5 0 6 


7 0 5 015 4 


020260 


7 0127 0 2 


02O510 


7022715 


020262 


7000017 


02O512 


7G50142 


020264 


7012702 


020514 


7001002 


020266 


7O50210 


02O516 


7 0 0 0127 


020270 


7 0 0 5 027 


02O520 


70212O4 


020272 


7050142 


0 205 2 2 


7012727 


02O274 


7 01 10 27 


02O524 


7 0 5 015 2 


020276 


7050140 


020526 


705O156 


020400 


7 012 2 0 4 


O20520 


7074127 


0204O2 


7O06227 ■ 


02O522 


7050156 


020404 


7050140 


O20524 


7011502 


020406 


7 1 9 2 0 0 2 


820526 


7074227 


02O410 


7074427 


0 205 4 0 


7050156 


020412 


7050142 


020542 


7022727 


020414 


7077207 


020544 


7050156 


020416 


7022727 


020546 


7050142 


02042O 


7 0 0 0 0 0 0 


02O550 


7001002 


020422 


705O142 


020552 


7 O 0 0127 


O20424 


7 0 01 0 0 2 


020554 


7 0 21 2 0 4 


O20426 


7O00127 


020556 


7005725 


02O420 


7021210 


020560 


7805724 


020422 


7022727 


020562 


7O05227 


020424 


7050246 


020564 


7050154 


020426 


7050142 


020566 


7O02250 


020440 


7001002 


020570 


7006201 


020442 


7600127 


02O572 


7077241 


020444 


7021274 


02O574 


7O05227 


020446 


7012727 


020576 


7020470 


02045O 


700400O 


020600 


70014O6 


020452 


705015O 


02O602 


7O00240 


02O454 


7012727 


020604 


7006227 


020456 


7 0 0 0 0 0 0 


O20606 


7050150 


020460 


7050152 


02O610 


7006227 


020462 


7012701 


O20612 


7050152 


020464 

* 


7050150 


020614 

* 


7O00722 
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w 



02O616 


/0O0240 


02062O 


7 0 0 016 7 


02O622 


7 0 0 0 0 0 0 


020624 


7012737 


0 2 0 6 2 6 


7 0 0 2 0 0 0 


020630 


702045 0 


020632 


7012737 


O20634 


7 0 04 0 0 0 


020636 


7020456 


020640 


7012737 


820642 


7008012 


O20644 


702047 0 


020646 


7012737 


020650 


7050260 


02O652 


7020474 


020654 


7012737 


020656 


7050316 


0206 60 


7020500 


020662 


70127 3 7 


020664 


7008012 


020666 


7020504 


02O670 


7012737 


020672 


7000404 


020674 


7020510 


02O676 


7 O 6 2 7 3 7 


02O700 


7 0 0 0 0 6 4 


020702 


7 0 2 0 6 2 2 


O20704 


7 0 0 013 7 


020706 


7D20446 


02O710 


7012737 


020712 


70010Q0 


020714 


7020450 


020716 


7012737 


020720 


7006000 


020722 


7020456 


020724 


7012737 


020726 


7 0 0 0 011 


020730 


<■ 0 7 0 4 r 0 


O20732 


7012737 


020734 


7050274 


020736 


7020474 


020740 


7012737 


020742 


7050332 


020744 


7020500 


020746 


7012737 


020750 


7 0 0 0 0 0 4 


020752 


7020504 


020754 


7 0 6 2 7 3 7 


020756 


700O056 


02076O 


7020622 


02O762 


700O137 


02D764 


‘ 7O20446 



M 




020766 


7012737 


020770 


7000400 


020772 


7020450 


020774 


7012737 


020776 


7 0 0 5 0 0 0 


G21000 


7020456 


021002 


7012737 


021004 


7 0 0 0 0 1 0 


021006 


7020470 


G21010 


7062737 


021012 


7 0 0 0 0 3 4 


021014 


7020622 


O21016 


70O0137 


O2102D 


7020446 


021022 


7012737 


021024 


7000100 


021826 


7020450 


021O30 


7012737 


021032 


7 0 0 4 4 0 0 


021034 


7O20456 


021036 


7012737 


021040 


7 0 0 0 0 0 6 


021042 


702O470 


021044 


7062737 


021O46 


7 0 0 0 0 3 4 


021050 


7020 6 2 2 


021052 


7000137 


021O54 


7 0 204 4 6 


021056 


7 012 737 


021060 


7000040 


O21062 


7020450 


021O64 


7012737 


021066 


70042O0 


021070 


7020456 


021072 


7012737 


021074 


7000005 


021O76 


7020470 


021100 


7062737 


O21102 


7000034 


021104 


702O622 


0211O6 


70O0137 


021110 


7020446 


021112 


7012737 


021114 


7000020 


021116 


7 0 2 0 4 5 0 


021120 


7012737 


021122 


7G04100 


021124 


7020456 



* 
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w 




021450 


7005227 


021402 


7050104 


021404 


7001405 


021406 


711D227 


021410 


7050250 


021412 


7005720 


021414 


7000127 


021416 


7020260 


021420 


7106202 


021422 


7106202 


021424 


7106202 


021426 


7106202 


021420 


7012702 


021422 


7 0 G 0 0 G 4 


021424 


7 1 G 6 2 G 2 


021426 


7106127 


021440 


7 G 5 0 2 5 0 


021442 


70772Q4 


021444 


7000412 


021446 


7 0 G 5 7 2 0 


021450 


7112727 


021452 


7 0 5 0 2 5 O 


021454 


7 O 5 6 0 O 0 


021456 


7 0 0 5 2 2 7 


021460 


7021454 


021462 


7 0 G G 2 4 S 


021464 


7 G 0 0 2 4 G 


021466 


700G127 


021470 


7020252 


021472 


7905227 


021474 


7050102 


021476 


7002262 


021500 


7012727 


0215O2 


7G56G00 


021504 


7021454 



MINIMUM D I STfiNCE DECODER FOR THE CODE (15/4) 



w 






W 




020456 


7900240 




020622 


7 0 0 0 2 4 0 


02B460 


7 0 0 0 2 4 0 




020624 


7O00240 


020462 


7O00240 




020626 


7O00240 


020464 


7 012 7 0O 




020620 


7 0 0 0 2 4 0 


020466 


7 0 5 2 0 0 0 




020622 


7012702 


020470 


7012727 




020624 


7050100 


020472 


705010 0 




020626 


7012700 


02O474 


7 0 5010 2 




02O640 


7054000 


020476 


7062727 




020642 


7012701 


020500 


7 0 5 010 0 




020644 


70 56 0 0 0 


020502 


7O5010 2 




020646 


7 0 1 2 7 O 5 


020504 


7012701 




02065O 


70O0002 


020506 


7O5010 4 




02O652 


7005004 


02O510 


7012702 




02O654 


7O12046 


020512 


7 0 5 4 0 0 0 




02O656 


7012046 


020514 


7012704 




02066O 


7012702 


02O516 


7000017 




020662 


70O0004 


020526 


7 0 0 5 O 2 7 




02O664 


7 0 0 6 2 1 6 


020522 


705O116 




020666 


7006104 


020524 


7 0110 0 5 




020670 


7077202 


020526 


7074105 




02O672 


7005726 


0 2 0 5 2 0 


70127O2 




020674 


7077507 


0 2 0522 


7 0 0 0 017 




020676 


7110421 


02O524 


7 0 0 6 2 9 5 




020700 


7077216 


020526 


7005527 




0207O2 


7 0 0 0 0 0 0 


020540 


705O116 




* 




020542 


70772O4 








020544 


7022727 








020546 


7 0 0 0 0 0 4 








02055O 


7O50116 








020552 


7 0 0 2 01 0 








020554 


7O06 201 








020556 


7 10 24 0 2 








020560 


7077421 








0205 6 2 


7000407 




• 




020564 


7 0 62 701 








020566 


7000002 








020570 


7077425 








020572 


70O0 402 








020574 


7010122 








020576 


7005720 








020600 


7 0 O 0 4 0 2 








02060 2 


7012722 








02O604 


70O0000 








020 60 6 


7005720 








020610 


7162727 








020612 


7000001 








020614 


705O102 








020616 


7 0 0 2 2 2 6 








62O620 


7000240 
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SVNDROME METHOD DECODER FOR THE CODE (15,8) 



W 




620252 


7012700 


02O254 


7052000 


020256 


70127O1 


02O260 


7 0 5 6 0 O 0 


020262 


7 0 1 2 7 O 2 


02O264 


7050100 


02O266 


7011027 


020270 


705010 2 


020272 


7 0127 02 


020274 


7020620 


020276 


7012784 


0 2 0 2 0 0 


7 0 0 0 017 


020202 


7005O27 


020204 


7050104 


026206 


7012205 


020210 


7006227 


020212 


7050102 


020214 


7 1 0 2 0 0 2 


0 2021 6 


7074527 


02O220 


7050104 


020222 


7677407 


0 2 0224 


7005727 


020226 


7 05010 4 


0 2 0 2 2 O 


7001421 


020222 


7012702 


020224 


7020776 


02O226 


7012704 


020240 


7 O 2 0 6 6 6 


020242 


7012727 


020244 


7 O 0 00 4 4 


020246 


7050106 


02O250 


7 0 2 2 7 2 2 


02O252 


7 0 5 0104 


0 2 0 2 5 4 


7001405 


02O256 


7 0 O 5 724 


020260 


7005227 


020262 


7050106 


020 264 


700 2271 


020266 


7 0 O 0 4 0 2 


020270 


7011405 


020272 


7074510 


O20274 


7 0 0 0 2 1 0 


020276 


7111021 


020 4 0 0 


7 0 05 7 2 0 


0204 02 


7077247 


020404 


70O0240 



* 
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OUTPUT PROGRAM 



w 




621510 


701270 0 


021512 


7 0 5 6 0 0 0 


021514 


7012792 


021516 


705010 0 


021520 


7105727 


021522 


7177564 


021524 


7 1 0 0 2 7 5 


G21526 


7111027 


021530 


7177566 


021532 


7122720 


021524 


7000215 


021526 


7001402 


02154O 


7077211 


021542 


7000420 


021544 


7 012 7 01 


021546 


7000012 


021550 


7105727 


021552 


7 1 7 7 5 6 4 


021554 


7100275 


021556 


7112727 


021560 


7 0 0 0 2 0 0 


021562 


7177566 


G21564 


7077107 


0 2 1 5 6 6 


7105727 


O21570 


7177564 


©21572 


7 100375 


021574 


7112727 


021576 


700O212 


02160O 


7177566 


021602 


7077222 


0216O4 


7000000 



APPENDIX H 
The simple run: 

. GE CO DEI. SRV 

. EXAMPLE FOR THE CODE <15,4) CHANNEL NOISE 
HRS INDEXING FACTOR 9 THIS IS LOW LEVEL 
NOISE FOR THE CODE . CARRIAGE RETURN HRS 
THE NOISE INHUNITV . TESTING FOR NOISSV CHANNEL. 



Decoding with minimum distance decoder ; 



EXAMPLE FOR THE CODE < 15, 4 > CHFiNNL NOIVE 
HAS INDEXING FACTOR 9 THIS IS LOW LEVEL 
NOISE JOR THE COTE .CARRIAGE RETURN HAS 
THE NOISE I HMUNI TV . TESTHNG FOR NOISSV JHRNNEL. 



Without decoding ; Without error correction 



QHR 

RLE D_RT T HE GGDM < 1 5 D 4 ! S & N E H 0 N _ I 0. E 
HAM INDEX INF ! FEKUOC! S'.THIC MS L K _ " D M V E 
FOVRU 6 0 " T H U SOTE. CERRI AGE RE DUVFHOSXUH 
NOSHt-I HI UASV. VEC PINV G_R JOIRC'X OHENEL. 
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